Exploring the diversity and invariance in yourself for visual pre-training task
نویسندگان
چکیده
Recently, self-supervised learning methods have achieved remarkable success in the visual pre-training task. By simply pulling different augmented views of each image together or other novel mechanisms, they can learn much unsupervised knowledge and significantly improve transfer performance models. However, these works still cannot avoid representation collapse problem, i.e., only focus on limited regions extracted features totally inside are nearly same. Generally, this problem makes models sufficiently describe multi-grained information images, which further limits upper bound their performance. To alleviate issue, paper introduces a simple but effective mechanism, called Exploring Diversity Invariance Yourself (E-DIY). pushing most view away, E-DIY preserve diversity region-level features. similar from same together, ensure robustness Benefiting above invariance exploring better extracts compared with previous approaches. Extensive experiments various downstream tasks demonstrated superiority our method, e.g., there is 1.9% improvement (compared recent state-of-the-art BYOL) AP50 metric detection task VOC.
منابع مشابه
the search for the self in becketts theatre: waiting for godot and endgame
this thesis is based upon the works of samuel beckett. one of the greatest writers of contemporary literature. here, i have tried to focus on one of the main themes in becketts works: the search for the real "me" or the real self, which is not only a problem to be solved for beckett man but also for each of us. i have tried to show becketts techniques in approaching this unattainable goal, base...
15 صفحه اولexploring motivation and english test preparation strategies of iranian pre-university candidates during and at the end of test preparation period for konkur examination
the current study aimed at investigating the relationship between motivation and test preparation strategies (tpss) used by iranian pre-university students in their preparation period for the university entrance exam (uee). due to the importance of uee in iran, this study also attempted to show its impact on these two important variables. to this end, 100 pre-university students in an iranian p...
phylogeography and genetic diversity of the lesser mouse- eared bat (myotis blythii) in iran
in current study, 63 samples of bat populations collected from differ regions were used for evaluating the geographic variations. twenty cranial and dental characters for traditional morphometric and landmarks method on the ventral, dorsal skull and mandible for geometry morphometric studies were used. statistical analyses of traditional morphometric and geometry morphometric data indicated low...
the role of visual aids and translation in teaching vocabulary in est
the present study investigated the effect of the two vocabulary teaching techniques in est, namely the use of translation and the use of visual aids as two separate vocabulary teaching techniques. to answer the question of the study, a pretest (michigan test) was administered to the 58 randomly selected est students at khajeh nasiredin tusi university, faculty of mechanics. after the homogeneit...
15 صفحه اولthe impact of pre-task planning on the improvement of iranian efl learners’ writing skill in task-based language teaching (tblt)
هدف اصلی تحقیق حاضر تبیین تاثیر برنامه ریزی پیش از انجام تکلیف بر بهبود مهارت نوشتاری زبان آموزان ایرانی در آموزش زبان تکلیف محور می باشد. به بیانی دیگر، این مطالعه رابطه بین برنامه ریزی پیش از انجام تکلیف و دو ویژگی زبانی در عملکرد نوشتاری یعنی پیچیدگی و دقت در مهارت نوشتاری را در سی یادگیرنده زبان در دو بخش عمده بررسی می کند. ابزارهای مورد استفاده برای جمع آوری داده ها در مطالعه حاضر شامل آزم...
15 صفحه اولذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Pattern Recognition
سال: 2023
ISSN: ['1873-5142', '0031-3203']
DOI: https://doi.org/10.1016/j.patcog.2023.109437